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Abstract 

We study the stability of single server retrial queues under general distribution 
for retrial times and stationary ergodic service times, for three main retrial policies 
studied in the literature: classical linear, constant and control policies. The approach 
used is the renovating events approach to obtain sufficient stability conditions by 
strong coupling convergence of the process modeling the dynamics of the system 
to a unique stationary ergodic regime. We also obtain instability conditions by 
convergence in distribution to improper limiting sequences. 
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Introduction 

The analysis of stability in queueing systems is the first step in studying such 
models. The steady state solutions and performance characteristics of the sys- 
tem do not exist if it is not stable. The efficiency of a queueing system is related 
closely to its stability and is considered as inefficient if it is unstable. Retrial 
queues have the characteristic that an arriving customer who finds all waiting 
positions and service zones occupied must join a group of "blocked" customers 
in an additional queue called "orbit" and reapplies for getting served after ran- 
dom time intervals according to a specific retrial policy. They arise in many 
practical situations. The classical example can be found in telephone traffic 
theory where subscribers redial after receiving a busy signal. For computer 
and communication applications, peripherals in computer systems may make 
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retrials to receive service from a central processor. Another example can be 
adopted from the aviation where an aircraft is directed into the waiting zone, 
if the runway is found busy, from which the demand of landing is repeated at 
random periods of time. Retrial queueing models are generally more compli- 
cated than traditional ones especially when dealing with general distribution 
for retrial times. The existence of this supplementary flow from the orbit and 
the random access to the server (as for the linear policies that depend on the 
number of customers in orbit) make the system more congested and difficult 
to model by simple random processes like Markovian ones, which have prop- 
erties that allow to derive easily conditions for stability, especially when we do 
not assume an exponential distribution (which has the memorylless property) 
allowing to obtain Markovian processes modeling the system. Furthermore, 
it has been observed in telecommunication systems that the exponential law 
is not a good estimator for the distribution of retrial times (see Yang et al., 
1994). 

The subject of this paper is to analyze the stability of single server retrial 
queues under general distribution for retrial times and stationary ergodic ser- 
vice times (without independence assumption), for three main retrial policies 
studied in the literature: classical linear, constant and control policies. Stabil- 
ity results for such models with general retrial times are rare and generally 
reduced to Markovian assumptions. For the linear retrial policy, Koba and Ko- 
valenko (2004) obtained a sufficient stability condition (arrival rate is less than 
the service rate) for an M/G/1 system with non-lattice distribution for retrial 
times satisfying an additional estimate condition, with i.i.d service times. For 
the constant retrial policy, Koba (2002) derived a stability condition for a 
GI/G/1 retrial system with a FIFO discipline for the access from the orbit to 
the server and a general distribution for orbit time in latticed and non-latticed 
cases with i.i.d service times. For the control policy, Gomez-Corral (1999) stud- 
ied extensively an M/G/1 retrial queue with general retrial times where he 
derived the stability condition for i.i.d service times and a FIFO discipline. 
For non-independent service times, Altman and Borovkov (1997) obtained a 
sufficient condition for the stability of a linear retrial queue under general sta- 
tionary ergodic service times and independent and exponentially distributed 
interarrival and retrial times using the method of renovation events. Kernane 
and Ai'ssani (2006) obtained sufficient conditions for the stability of various 
retrial queues with versatile retrial policy which incorporates the constant 
and linear retrial policies under general stationary ergodic service times and 
independent and exponentially distributed interarrival and retrial times. 

The main approach used in this paper is the method of renovation events 
originated in the work of Akhmarov and Leont'eva (1976) and developed by 
Borovkov (1984) in the stationary ergodic setting. In the following section, 
we derive stability and instability conditions for the classical linear retrial 
policy with general retrial times, stationary ergodic service times and Poisson 
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arrivals. In Section 3, we obtain a stability condition and an instability one 
for the constant retrial policy system with general retrial times, stationary 
ergodic service times and Poisson arrivals. With the later assumptions, we 
derive in Section 4, stability and instability conditions for the control policy 
retrial model. 



1 Linear Retrial Policy 

We begin by considering the classical single server retrial system with linear 
retrial policy. Customers arrive from outside according to a Poisson process 
with rate A. If an arriving customer finds the server busy, he joins the orbit 
and repeats his attempt to get served after random time intervals. We consider 
the linear retrial policy where each customer in orbit attempts to get served 
independently of other customers and we assume that the sequence of inter- 
retrial times of a single customer is an independent sequence with general 
distribution R{-), density function r(-) and Laplace transform r*{z), z > 0. 
The successive service times {cr„} are assumed to form a stationary (in the 
strict sense) and ergodic (which essentially means that time averages converge 
to constants a.s) sequence with < Ecr^ < oo. The inter-arrival, inter-retrial 
and service times are assumed to be mutually independent. 

Let Q{t) be the number of customers in orbit at time t and denote by Sn 
the instant when the nth service time ends. Consider the embedded process 
Qn = Q{sn+) of the number of customers in orbit just after the end of the nth 
service duration. Denote by Nx{t) the counting Poisson process with parameter 
A which counts the number of arriving customers during a time interval (0,t]. 
If Qn = k, then we denote by 7ri(n), nk{n) the residual retrial times (forward 
recurrence times) of the customers in orbit just after the instant s„ and by 7„ 
the residual external arrival time at the same instant. 

It is easy to see that the process Qn satisfies the following recurrence relation: 

Qn+l^iQu + ^n)"-, (1) 

where = max[0, x] and 

= Nx(an) - I{min(7ri(n), ...,7rQ„(n)) < 7„} , (2) 

We have then expressed Qn as a, Stochastic Recursive Sequence (SRS) (for the 
definition see Borovkov, 1998). 

We introduce the a— algebra JF^ generated by the set of random variables 
{ak : k < n} and generated by the entire sequence oo<n<+oo} 
and for which any independent sequence not depending on {an} is J^^'-measurable 
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(see Borovkov (1976) p.l4). Let U be the measure preserving shift transforma- 
tion of jF'^-measurable random variables, that is Uak = crk+i, and if 77 G 
then the sequence {rjn = U""r] : —00 < n < +00} is a stationary ergodic 
sequence where U"" is the nth iteration of U and is the inverse transfor- 
mation of f/" n G Z. We shall denote by T the corresponding transformation 
of events in JF°", that is for any JF""- measurable sequence ?7„ : 

T{uj : {rio{uj), ...,r]k{uj)) G {Bo,...,Bk)} = {uj : {r]i{uj), ...,rik+i{uj)) G {Bq, Bk)} , 

(3) 

where the events Bi G JF*^, i = 0, fc. 

An event A G J^^+m, m > 0, is a renovation event for the SRS {Qn} on the 
segment [n, n + m] if there exists a measurable function g such that on the set 
A 

Qn+m+l = g{^n, ■■■,^n+m)- (4) 

The sequence An, An G J-'n+m, is a renovating sequence of events for the SRS 
{Qn} if there exists an integer no such that (jl]) holds true for n > uq with a 
common function g for all n. 

We say that the SRS {Qn} is coupling convergent to a stationary sequence 
{g" = t/"g°} if 

]im P {Qfc = V A; > n} = 1. (5) 
Set z/fc = min{n > —k : U~^Qn+k = Q"} and z/ = sup^>o Uk- 

A SRS {g„} is strong coupling convergent to a stationary sequence {g" = f/"g°} 
if z/ < oo with probability 1. 

Theorem 1 Assume that AEcti < 1. Then the process {Qn} is strong coupling 
convergent to a unique stationary ergodic regime. 

If AEo"! > 1, then the process {Qn} converges in distribution to an improper 
limiting sequence. 



PROOF. Since the driving sequence C,n depend on g„, we will proceed first 
by considering an auxiliary sequence g* which majorizes g„ and having a 
driving sequence ^* independent of Qn and it has the following form: 

Q*o = Qo, Q:+i = max(C,g: + C), (6) 

where 

Cn = Nx{an) - I {min(7ri(n), 7rc(n)) < 74 . (7) 

The constant integer C will be chosen later appropriately, and if g* > C the C 
customers for which we consider the forward recurrence times tti (n) , . . . , ttc (n) 
are chosen randomly by an urn scheme without repetition. Following the pro- 
cedure used in Altman and Borovkov (1997) and later in Kernane and Aissani 
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(2006), we will construct stationary renovation events with strictly positive 
probability for Q,„ from those of Q*, and applying an ergodic theorem (The- 
orem 11.4 in Borovkov, 1998) which states that an SRS is strong coupling 
convergent to a unique stationary regime, satisfying the same recursion, if 
there exist stationary renovating events of strictly positive probability. 
The stationarity and crgodicity of follows from the fact that ^* is T"- 
measurable (for more details on the ergodicity and stationarity of ^* see Ker- 
nane and Aissani, 2006). We have 



(min(7ri(n), ...,7rc(n)) < 7„) 
-P(7ri(n) >7„,...,7rc(n) > 

oo 

1- J Ae"^* P(7ri(n) > t, ...,7rc(n) > t) dt 



1- J Xe'^^ HFimin) > t) dt 



= XEa, - [1 - P {m{n) > 7„, nc{n) > 7. 
= AEcTi 

= XEai 



(9) 
(10) 

(11) 



Since \imc-^oo H P(7''i(^) > ^) = 0, then by dominated convergence theorem 

i=l 

00 ^ 

Jim J Ae"^* [] HMiT') >t) dt = 0. (12) 

Q i = l 

If the condition XEa, < 1 is satisfied, we can choose the constant C such 
that < 0. It follows from example 11.1 in Borovkov (1998) that there 
exists a stationary renovating sequence of events with positive probability for 
Q^, from which we deduce those of Qn (see Altman and Borovkov, 1997). 
Applying the ergodic theorem (Theorem 11.4 in Borovkov, 1998) we obtain 
that the sequence Qn is strong coupling convergent to a unique stationary 
process Qn — U"'Qo, with Qq ^'^-measurable and since Qn is an [/—shifted 
jF'^-measurable sequence then it is ergodic. 

For the instability condition, consider the auxiliary process Qn corresponding 
to a simple single server queue without retrials, that is 

Qo=Qo, Q'n+l-{Qn+&: (13) 

where 

= N.ian) - 1. (14) 

Clearly Q^ <st Qn and it is well known that if AEui > 1 then lim„_»oo Qn ~ 
+00 a.s. (see Theorem 1.7 in Borovkov, 1976). Thus, the process {Qn} con- 
verges in distribution to an improper limiting sequence. 
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2 Constant Retrial Policy 



Consider now a single server retrial queue governed by the constant retrial 
policy which is described as follows. After a random time generally distributed 
(which we will call the orbit retrial time), one customer from the orbit (at the 
head of the queue or a randomly chosen one if any) take his service if the 
server is free, so an orbit time can be in progress even though the server is 
busy, this may happen in system where the orbit has no information about 
the state of the server. The sequence of orbit cycle times {rj} is assumed to be 
i.i.d, having R{-) as cdf, r(-) as density function with mean Eri and Laplace 
transform r*{z), z > 0. Let 7i{n) be the forward recurrence time of the orbit 
retrial time after the end of the nth service time. Then the process Qn has 
now the following representation as a SRS: 

Qn+l = (Qn + en) + , (15) 

where 

en = iVA(a„)-I{7r(n) <7j. (16) 
Theorem 2 If R is nonlattice and 

^^^^ < XEr, ' ^^^^ 

then the process {Qn} is strong coupling convergent to a unique stationary 
ergodic regime. 

// AEui > (1 — r*(A))/(AEri). Then the process Qn converges in distribution 
to an improper limiting sequence. 



PROOF. We have 

E^n = AEcTi - P (7r(n) < 7„) . (18) 

Since the interarrival times are exponentially distributed then so is the residual 
arrival time 7„, hence 

P (7r(n) < 7n) = y" P (7r(n) < t) X e'^^dt. (19) 



Since we are interesting on steady state behaviour of the system and by as- 
suming a nonlattice (also called non-arithmetic) distribution R{t) for orbit 
retrial times, then from a well known result in renewal theory (see Cox, 1962) 
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we have the following asymptotic distribution for the forward recurrence time 



P(7r(n) < t) 



t 

^ f[l- R{x)] dx. 



Eri 



(20) 



The formula ffTOD becomes 



+00 +00 
F{n{n) < 7„) = — f [1 - R{x)] f Xe~^^dt dx 





+00 



J- [ [1- R(x)] e-^" (ia; = ^ 



1 -r*(A) 
A 



(21) 
(22) 



Now if condition (ITTI) is satisfied then E,^„ < 0. Since ^„ is jF°"-measurable 
(generated by cr.„) then it is a stationary ergodic sequence. From this and 
example 11.1 in Borovkov (1998), there exists a stationary sequence of reno- 
vation events with positive probability for Hence, using Theorem 11.4 of 
Borovkov (1998), the sequence {Qn} is strong coupling convergent to a unique 
stationary sequence Qn obeying the equation Qn+i = (Qn + ^n)"*", the ergodic- 
ity of Qn follows from the fact that Qn is an [/—shifted sequence {Qn = U"'Qo, 
with Qq ^0 -measurable) generated by the stationary and ergodic sequence 
The instability condition AEci > [1 — t*(A)] /AEri yields to > 0, and it 
is well known that for SRS of the form Qn+i = {Qn + ^n)"*" this implies the 
convergence of the process Qn to an improper limiting sequence (see Theorem 
1.7 of Borovkov (1976)). 



2.1 Exponential retrial times 



By assuming an exponential distribution with parameter 6 for retrial times, 
that is R{x) = 1 — e~^^', it is well known that r*{s) = s/{s + d), and Eri = 1/0. 
The condition f|T7j) will read up, after some algebra, as follows 

AEai < j^. (23) 

Which is the condition obtained in the paper of Kernane and Aissani (2006), 
in exponential retrial context. 



3 Retrial Control Policy 



Consider a single server retrial queue with a control retrial policy. Primary 
customers enter from the outside according to a Poisson process with rate A. 
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If a primary customer finds tlie server busy upon arrival it joins the orbit 
to connect later according to the control retrial policy, which is described as 
follows. Just after the end of a service time a generally distributed retrial time 
begins to find the server free. If the retrial time finishes before an external 
arrival, then one customer from the orbit (at the head of the queue or a 
randomly chosen one if any) receives its service and leaves the system. We 
assume that the sequence of retrial times {r„} is an i.i.d sequence having r(-) 
as pdf, R{-) as cdf and Laplace transform r*(-), with finite mean Eri. The nth 
service duration of a call is cr^ and we assume that the sequence of service 
times {(Jn} is stationary and ergodic with < Eai < oo. 

The process {Qn} has the following representation as a stochastic recursive 
sequence SRS: 

Qn+l = (Qn + a) + , (24) 

where 

in = Nxian)-l{rn<ln}, (25) 

where 7„ is the residual arrival time of an external call at the end of the nth 
service period. 

Theorem 3 Assume that 

XEai < r*(A). (26) 

Then the process Qn is strong coupling convergent to a unique stationary er- 
godic regime. 

If XKai > r*(A). Then the process Qn converges in distribution to an improper 
limiting sequence. 



PROOF. The proof is similar to that of Theorem 2, by noting that E,^„, = 
AEffi -r*(A). 



3.1 Exponential retrial times 



Assume that the retrial times are exponentially distributed with mean 1/6, 
then r*(A) = 9/{X + 6) and the stability condition fl26l) becomes: 

AE., < (27) 

This condition is quite evident since it can be obtained from the constant 
policy from the memorylless property of the exponential distribution. 
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3.2 Hyperexponential distribution for retrial times 



Assume now that the retrial times follow the hyperexponential distribution 
with density r{x) = p6 exp{—6x) + (1 — p) exp(— 6*^0;), < p < 1. Then 
r*(A) = e[X{p+{l-p)e) + e^] /(A + e){X + e"^) , and the stability condition 
(l26l) in this case is 



3.3 The Erlang distribution for retrial times 

The Erlang distribution has been found useful for describing random variables 
in queueing applications. The density of an Erlang (n, /i) distribution is given 
by r{x) = fi"^ exp{—fix)x"'~^ / (n — 1)!, x > and n G N*. Its Laplace transform 
is r*(s) = /i"/ (s + /i)" . Then the control policy model will be stable if 



Remark 4 It should be noted that the assumption = 0, and weak depen- 
dence among the does not preclude the possibility that the process {Qn} 
converges to a proper stationary regime. 

Remark 5 Conditions for the stability of modified models with general retrial 
times, such as allowing breakdowns of the server, two types of arrivals, neg- 
ative arrivals and batch arrivals models may be obtained easily following the 
procedure used in Kernane and Ai'ssani (2006). The conditions of the stability 
will be written by replacing the left hand side of the classical linear policy by 
the left hand sides of the case of a linear versatile policy obtained in Kernane 
and Ai'ssani (2006). For the constant policy, we have to make the appropri- 
ate changes to the driving sequences in the SRS modeling the dynamics of the 
modified models in Kernane and Ai'ssani (2006) by considering the residual 
orbit time as shown here in Section 3, the conditions of stability will follow 
directly after some algebra. 

Remark 6 We may also consider the versatile retrial policy by incorporating 
the residual orbit retrial time 7r(n) in the equation\^ and considering the whole 
retrial times of the customers in orbit ri(n), ...,rQ^(n) as follows 



in = - I{min(7r(ra) + ri(n), ...,Tc{n) + rQ,^(n)) < 7„} , (30) 



the condition of Theorem 1 still holds for this versatile retrial policy, by noting 




(28) 




(29) 
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that in the proof we have to consider 



oo t 

J J '^e"^* P (ri(n) >t-s, rc{n) >t-s) dG{s)dt 



(31) 

where G{s) is the cdf of the residual orbit retrial time satisfying 



G{s) = ^ / [1 - A{x)] dx, (32) 



with EcKi the mean of the orbit retrial time and A{x) its cdf. 
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